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METHOD OF CREATING MULTIMEDIA CONTENT USING 
SYNCHRONIZED MULTIMEDIA INTEGRATION LANGUAGE AND 
MULTIMEDIA CONTENT MADE THEREBY 

«ArKr,ROUW^ ^"^^ INVENTION 

[01] -nus application claims the benefit from Korean Patent Application No. 
10-2002-0074641, filed on November 28, 2002, in the Korean Intellectual 
property Office, the disclosure of which is incorporated herein in its entirety by 
reference. 

1 . Field of the Invention 

[«21 The present invention relates to the Synehronized Multimedia Integration 
Language (SME.), and more particularly, to a meU,cd of creating multimedia 
content using the Synchronized Multimedia Integration Language (SMIL) and the 
multimedia content created thereby. 

2. Description of the Related Art 

[03] The Synchronized Multimedia Integration Language (SMIL) is a markup 
language for multimedia layout or multimedia presentation based on the 
Extensible Markup Language (XML) recommended by the World Wide Web 
consortium (W3C). SMIL is used to integrate various types of separate media 
data such as audio data, video data, musical instrument digital interface (MIDI) 
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data, text, images, and the like into synchronized multimedia content for 
controlling the play time of the respective media data, and for controlling and 
dividing a screen layout. 

[04] As with the Hypertext Markup Language (HTML), SMIL can be created 
through a text editor. SMIL also has a small number of elements. Moreover, 
SMIL is easy to learn because its granmiar is consistent with XML. Thus, a user 
can create multimedia content more easily using SMIL. 

[05] Multimedia content is widely used for education. For example, when 
education content is created using SMIL for selection-type questions and answers 
thereof, the results for user inputs can be displayed by using EventBase or 
SyncBase. An example for this is as follows. 



<par> 

<image id= "imgl". . ./> 
<image id= "img2". . ./> 
<image id= "img3". . ./> 
<text id= "rightAnswer". . . 

begin= "imgl.activateEvent" 

.../> 

<text id= "wrong". . . 
begin= "img2.activateEvent; 
img3 . ac ti vateE vent ; 
img4.activateEvent". . ,/> 
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[06] The above example shows a case where the image with identifier "imgl" 
represents the right answer. If a user selects the image with identifier "imgl", a 
corresponding event is generated, and a text with identifier "rightAnswer" is 
displayed. If the other images with identifiers "img2", "img3", and "img4" are 
selected by the user, corresponding events are generated, and a text with 
identifier "wrong" is displayed. 

[07] However, with SMIL, it is not possible to assign marks for tracking total 
answer results or allot different marks based on individual test item importance. 
This is because SMIL does not have a memory function capable of storing 
variables. It is possible to implement the memory function to store the variables 
in SMIL by programming the functionality into SMIL. However, in order to 
program the functionality into SMIL, it is required to have full knowledge of a 
new programming language. In addition, since the data size of the multimedia 
content becomes larger, and the multimedia content is transmitted through a 
network, data traffic increases. Also, a separate interpreting engine for 
interpreting the programming language is needed when the multimedia content is 
reproduced. Considering the increasing demand for transmitting multimedia 
content to mobile terminals, an increase in traffic and an additional interpreting 
engine are not acceptable. 

SUMMARY OF THE INVENTION 
[08] The present invention provides a method of creating multimedia content 

that allows simple and easy design of a memory function using Synchronized 
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Multimedia Integration Language (SMIL) without involving additional 
programming knowledge, and the multimedia content created by the method. 

[09] According to one exemplary aspect of the present invention, there is 
provided multimedia content which is created using Synchronized Multimedia 
Integration Language (SMIL). The multimedia content comprises a first element 
which has an attribute that initializes variables and a second element which has 
an attribute that implements a memory function by expressing an operation on a 
variable. 

[10] The multimedia content further comprises a third element which 
expresses results of the operation on the variables. The third element has an 
attribute that expresses an executing condition of the third element. 

[11] The attribute of the second element expresses at least one from the group 
of an arithmetic operation, a relational operation, a logical operation, and an "if" 
phrase of the variables. Preferably, the attribute of the second element contains a 
processing condition for processing the operation on the variables. 

[12] The operation on the variables of the second element is processed when 
the second element is parsed. 

[13] The attribute of the first element is expressed as an attribute name = 
"variable=0;", and the attribute of the second element is expressed as an attribute 
name = "operation on variable". 

[14] The attribute of the first element is expressed as vap="x=0;", and the 
attribute of the second element is expressed as var="x=x4n;" (here, ♦ is an 
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arithmetic operator and n is a numeric value if required by the arithmetic 
operator). The attribute of the first element is expressed as var="x=0;", and the 
attribute of the second element is expressed as var="count++; sum+=20;". 

[15] The attribute of the third element is expressed as an attribute name = 
"executing condition of corresponding tag". The attribute of the third element is 
expressed as condition = "executing condition". 

[16] According to another exemplary aspect of the present invention, there is 
provided multimedia content which are created using Synchronized Multimedia 
Integration Language (SMIL). The multimedia content comprises at least one 
first element and a second element which has an attribute that expresses a 
function for the element and the content to be processed when the function is 
true. 

[17] The function is true when a rendering region of a corresponding element 
overlaps with a rendering region of a predetermined element, and the attribute of 
the second element expresses completion of rendering of the corresponding 
element if the function is true. . . 

[18] The function is true when rendering regions of the first elements overlap 
with one another, and the attribute of the second element expresses a beginning 
of rendering of the corresponding element if the function is true. 

[19] According to yet another exemplary aspect of the present invention, there 
is provided a method of creating multimedia content using Synchronized 
Multimedia Integration Language (SMIL). The method comprises initializing 
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variables by using an attribute of a first element and (b) implementing a memory 
function by expressing an operation on the variables by using an attribute of a 
second element. 

[20] Preferably, but not necessarily, the method further comprises (c) 
expressing an executing condition of a third element according to results from 
operations on variables using an attribute of the third element. 

[21] Preferably, but not necessarily^ step (b) is characterized by implementing 
a memory function by expressing at least one from the group of an arithmetic 
operation, a relational operation, a logical operation, and an "if* phrase of the 
variables. 

[22] Preferably, but not necessarily, step (b) further comprises adding an 
executing condition for executing the operation on the variables. Preferably, but 
not necessarily, step (b) further comprises expressing the executing condition 
using timing attributes defined in SMDL, and the operation on the variables of 
step (b) is processed when a corresponding element is parsed. 

[23] Step (a) is initiahzed as an attribute name = "variable = 0;", step (b) is 
initialized as an attribute name = "operation on variable;", step (a) is initialized as 
var="x=0;", and the second element is initialized as vap="x= x^n;" (here, ♦ is an 
arithmetic operator and n is a numeric value if required by the arithmetic 
operator). 

[24] Step (c) can be expressed as an attribute name = "executing condition of 
corresponding tag", and preferably, expressed as var = "'if phrase". 
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[25] According to yet another exemplary aspect of the present invention, there 
is provided a method of creating multimedia content using a Synchronized 
Multimedia Integration Language. The method comprises (a) defining at least 
one function in an element and (b) expressing content to be processed when the 
function is true using an attribute of the element. 

[26] Step (b) is characterized by expressing the content using an action 
attribute of the element. 

[27] Step (a) comprises defining the function as true when a rendering region 
of a corresponding element overlaps with a rendering region of a predetermined 
element, and step (b) is characterized by completing rendering of the 
corresponding element if the function is true. Preferably, but not necessarily, step 
(a) comprises defining a function as true when rendering regions of at least one 
element overlap with one another, and step (b) is characterized by starting 
rendering of a corresponding element using the action attribute. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[28] The above and other features and advantages of the present invention will 
become more apparent by describing in detail exemplary embodiments thereof 
with reference to the attached drawings in which: 

[29] FIG. 1 is a block diagram of a device for reproducing multimedia content 
according to an embodiment of the present invention; 

[30] FIG. 2 is a schematic view of Synchronized Multimedia Integration 
Language (SMIL) content according to an embodiment of the present invention; 
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[31] FIG. 3 is a schematic view of SMIL content used to create a frame of FIG. 
2; 

[32] FIG. 4 shows an example of the SMIL content in FIG. 2; 

[33] FIG. 5 shows another example of the SMIL content in FIG. 2; 

[34] FIG. 6 shows another example of the SMIL content in FIG. 2; 

[35] FIG. 7 shows another example of the SMIL content in FIG. 2; 

[36] FIG. 8 shows an example of using the variables stored by the memory 
function using operatioris on the variables implemented in FIGS. 4 through 7; 

[37] FIG. 9 shows an example of adding a processing condition for processing 
operations on variables; 

[38] FIG. 10 shows an example of adding a function to SMIL content 
according to the present invention; 

[39] FIG. 11 shows another example of adding a function to SMIL content 
according to the present invention; 

[40] FIG. 12 is a flowchart for explaining a method of creating multimedia 
content using SMIL with additional attributes, according to an embodiment of the 
present invention; 

[41] FIG. 13 is a flowchart for explaining a method of creating multimedia 
content using SMIL with additional attributes, according to another embodiment 
of the present invention; and 
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[42] FIG. 14 is a flowchart for explaining a method of creating multimedia 
content using SMIL with an additional function, according to an embodiment of 
the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 
[43] The present invention will now be described more fully with reference to 
the accompanying drawings, in which illustrative, non-limiting embodiments of 
the invention are shown. 

[44] FIG. 1 is a block diagram of a device for reproducing multimedia content 
according to an embodiment of the present invention. 

[45] Referring to FIG. 1, a device for reproducing multimedia content 
according to an embodiment of the present invention includes a Synchronized 
Multimedia Integration Language (SMEL) interpreting engine 1, a network 
cdnununication unit 2, and a storage unit 3. SMIL content denotes multimedia 
content which is made using SMIL and has additional attributes of defining and 
supporting a memory function for storing variables. That is, the SMIL content 
denotes content in which the memory function for storing variables is 
implemented. Detailed descriptions of the SMIL content will follow later. 

[46] The network communication unit 2 can connect to a network and retrieve 
SMIL content. The storage unit 3 stores the SMIL content. The storage unit 3 
may be an information storage medium such as a hard disk, memory, an optical 
disk, or the like. If the storage unit 3 is an optical disk, it additionally includes an 
optical disk drive (not shown) for reading the SMIL content stored in the optical 
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disk. The optical disk is removably mounted in the optical disk drive and capable 
of being removed. 

[47] The SMIL interpreting engine 1 parses, interprets, and executes the SMIL 
content. The SMIL interpreting engine 1 includes a decoder for decoding various 
multimedia files included in the SMIL content, e.g., audio files, image files, 
moving image files, or the like. In other words, the SMIL interpreting engine 1 
interprets, executes, and displays the SMIL content of the network 
communication unit 2 or the storage unit 3 on a display (not shown). The SMIL 
interpreting engine 1 also receives user inputs and performs operations 
corresponding to the user inputs. In particular, the SMIL interpreting engine 1 
parses the element of the SMIL content, which has an attribute that defines the 
operations on variables to implement a memory function, and processes the 
element if an executing condition of the element is satisfied. In addition, the 
SMIL interpreting engine 1 parses an element, which has an attribute that defines 
at least one function, and processes the element according to content to be 
processed if the function expressed using the attribute is true. Thus, user 
interaction can be supported through the use of SMIL content. 

[48] FIG. 2 is a schematic view of Synchronized Multimedia Integration 
Language (SMIL) content according to an embodiment of the present invention. 

[49] Referring to FIG. 2, SMIL content according to the present invention is 
used to represent multimedia content for education, especially, for the study of 
math at an elementary school level. A region for a title is provided on the top of 
a frame, and a region for study content is provided in the middle of the frame. 
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Additional descriptions and guide information are displayed at the bottom of the 
frame while the study content is expressed. 

[50] In particular, in the middle of the frame, study content such as questions 
are expressed. If a user desires to view the next page, the user clicks the "NEXT" 
button. 

[51] FIG. 3 is a schematic view of SMIL content used to create the frame of 
FIG. 2. 

[52] Referring to FIG. 3, a whole frame is defined as <rootLayout. . .>, the title 
region as <region id= "title"... >, the content region as <region id= "content"... >, 
and the caption region as <region id= "caption". . .>. 

[53] FIG. 4 shows an example of the SMIL content in FIG. 2. 

[54] Referring to FIG. 4, for the first question located in the middle frame, the 
right answer is an image with the identifier "imgl-1". If a user clicks the image 
with the identifier "imgl-l", a corresponding event is generated, and a text with 
the identifier "rightAnswer" is displayed. If the image of the wrong answer, i.e., 
the image with identifier "imgl-2", "imgl-3", or "imgl-4" is clicked, a 
corresponding event is generated, and a text with the identifier "wrong" is 
displayed. The right answer of the second question is an image with the identifier 
"img2-3". If the user clicks the image of the wrong answer, i.e., the image with 
the identifier "img2-l", "img2-2", or "img2-4", a corresponding event is 
generated and a text with the identifier "wrong" is displayed. 
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[55] In particular, according to FIG. 4, the number of right answers a user 
inputs can also be displayed. That is, in the element <image id= "imgl-l"... /> of 
the first question part, var="x=0;" is inserted as an attribute that initializes 
variables defined according to the present invention. In addition, in the element 
<text id= "rightAnswer"... /> of the first question part, var="x=x+l;" is inserted 
as an attribute that implements a memory function by expressing an operation on 
variables according to the present invention. In the element <text id= 
"rightAnswer"... /> of the second question part, var="x=x+r' is inserted as an 
attribute that implements a memory function by expressing an operation on 
variables according to the present invention. Thus, if the user clicks a right 
answer, the number of right answers that the user clicks is accumulated as the 
variable. Therefore, the total number of right answers before the next click can 
be displayed to the user. 

[56] FIG. 5 shows another example of the SMIL content in FIG. 2. 

[57] According to FIG. 5, a different weight can be assigned to each question. 
That is, in the element <text id= "rightAnswer... /> of the first question part, 
var="x=x+10;" is inserted as an attribute that implements a memory function by 
expressing an operation on variables according to the present invention. In the 
element <text id= "rightAnswer".. /> of the second question part, var= "x=x+20;" 
is inserted as an attribute that also implements a memory function by expressing 
an operation on variables according to the present invention. Thus, a weight of 
10 is assigned to the first question if the user clicks the right answer of the first 
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question and a weight of 20 is assigned to the second question if the user clicks 
the right answer of the second question. 

[58] FIG. 6 shows another example of the SMIL content in FIG. 2. 

[59] According to FIG. 6, a demerit mark can be given to the wrong answer. 
That is, in the element <text id= "wrong"... /> of the first question part, 
var="x=x-5" is inserted as an attribute that implements a memory function by 
expressing an operation on variables according to the present invention. In the 
element <text id= "wrong"... /> of the second question part, var="x=x-5" is 
inserted as an attribute that implements a memory function by expressing an 
operation on variables according to the present invention. Thus, if the user clicks 
wrong answers to the first and second questions, demerit marks of 5 are given for 
each of the wrong answers to the first and second questions. 

[60] FIG. 7 shows another example of the SMIL content in FIG. 2. 

[61] Referring to FIG. 7, the number of right answers and marks are 
respectively calculated and stored for display to the user. That is, in the element 
<text id= "rightAnswer".,. /> of the first question, vaF="count++; sum+=10;" is 
inserted as an attribute that implements a memory function by expressing an 
operation on variables according to the present invention. In the element <text 
id= "rightAnswer"... /> of the second question, var="count++; sum+=20;" is 
inserted as an attribute that implements a meniory function by expressing an 
operation on variables according to the present invention. Thus, the number of 
right answers and marks are simultaneously accumulated and stored. 
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[62] Variables stored by the memory function using operations on the 
variables implemented in FIGS. 4 through 7 can be used in various ways. 

[63] FIG. 8 shows an example of using the variables stored by the memory 
function using operations on the variables implemented in FIGS. 4 through 7. 

[64] Referring to FIG. 8, a text element with the identifier "good" is used to 
display the results of operations on variables. The text element is executed only 
when the total marks exceed 70, thus outputting a corresponding text. Likewise, 
a text element with the identifier "bad" is also used to display the results of 
operations on variables. The text element is executed only when the total marks 
are at or below 70, thus outputting a corresponding text. 

[65] In the meanwhile, operations on variables for executing the function 
implemented in FIGS. 4 through 7 are generally processed when corresponding 
elements are parsed. However, the time when operations on variables are 
processed can be controlled by adding an executing condition. 

[66] FIG. 9 shows an example of adding a processing condition for processing 
operations on variables. 

[67] Referring to FIG. 9, the element <image id= "imgl-1".../ > has vai^"if 
(activeEvent){x++;}" inserted as an attribute that expresses an executing 
condition of the element. Thus, the result derived from whether the user selects 
the right answer or not is not outputted, but the number of right answers is stored 
and can be later outputted. That is, the variable x increases by 1 only when the 
user clicks the image with the identifier "imgl-l". 
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[68] New attributes of SMIL according to the present invention can be 
described as follows. Table 1 shows attributes of SNHL, and table 2 shows 
detailed descriptions of the attributes. 



[Table 1] 



Attribute name 


Description 


var 


Phrase for an operation on variables 


condition 


Executing condition for a SMIL element 



[Table 2] 



Phrase 


Description 


Arithmetic operation 


+ - * / 


Four fundamental rules of arithmetic operation 


% 


Modulus operator 


++, -- 


Increment and Decrement operations 


Relational operation 


>, < 


Greater, Less than 


>=,<= 


Greater than or equals. Less than or equals 




Equal, not equal 


Logical operation 


!, &&, II 


NOT, AND, OR 


if 


Variable processing condition 



[Table 3] 



Condition 


Description 




begin. 






end. 


SyncBase Timing 


Timing attribute of 


repeat 




SMIL 
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BeginEvent, 






EndEvent, 








EventBase Timing 




repeatEvent, 




activateEvent 





[69] The processing condition on "if may include a Timing attribute of the 
element defined by conventional SMIL as shown in table 3 and an operation 
attribute defined in table 2. 



[70] It is possible to add a function to the operation on variables. For example, 
it is not possible to express, using conventional SMIL, that two animation images 
disappear if they collide with each other while they are moving. Conventional 
SMIL can process one image, such that one image starts to move by using a 
Timing attribute defined in table 3 when another image has completed. However, 
conventional SMIL cannot process two images such that the two images collide 
with each other. The present invention can solve such a problem by adding a 
function to conventional SMLL. 

[71] FIG. 10 shows an example of adding a function to SMIL content 
according to the present invention. 

[72] Referring to FIG. 10, a collision function is defined as true when 
rendering regions overlap. If the rendering region of an image with the identifier 
"imagel" and a rendering region of the element <img.../ > collide with each 
other, rendering of the element <img... /> is terminated by an action attribute 
including the collision function. 
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[73] FIG. 11 shows another example of adding a function to SMIL content 
according to the present invention, 

[74] Referring to FIG. 11, if rendering regions of an image with an identifier 
"imagel" and of an image with an identifier "image2" begin overlapping with 
each other, rendering of an image with an identifier "imageS" starts. 

[75] As shown in FIGS. 10 and 11 where collision of the two rendering 
regions are processed using the action attribute, if a condition of a function is 
satisfied, the function should be processed. If fundamental contents of the 
function are predefined, it is possible to express the desired function by using the 
fundamental contents. Also, it is possible to make a profile or a component by 
grouping content according to type or grouping functions according to function. 
In addition, it is possible to define a new function by combining defined 
functions. 

[76] Hereinafter, a method of creating multimedia content according to an 
embodiment of the present invention will be described. 

[77] FIG. 12 is a flowchart for explaining a method of creating multimedia 
content using SMIL with additional attributes, according to an embodiment of the 
present invention. 

[78] Referring to FIG. 12, in order to implement a memory function by 
expressing operations on variables, according to the present invention, variables 
are initialized using an attribute of a first element (step 1201). Then, operations 
of the initialized variables are expressed by using an attribute of a second element 
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(step 1202). The operations on the variables may be expressed using at least one 
of an arithmetic operation, a relational operation, a logical operation, or an "if 
phrase. An executing condition of a third element is expressed according to the 
results of the operations on the variables and using an attribute of the third 
element (step 1203), which is previously described with reference to FIG. 8. 

[79] FIG. 13 is a flowchart for explaining a method of creating multimedia 
content using SMIL with additional attributes, according to another embodiment 
of the present invention. 

[80] Referring to FIG. 13, a variable is initialized as an attribute 
name="variable=0;" to implement a memory function by expressing an operation 
on variables, according to the present invention (step 1301). For example, the 
variable is initialized as var^"x=0;". Then, an operation on the variable is 
expressed as an attribute name="operation on variable;" (step 1302), For 
example, the operation on the variable may be var="x=x4n" (here, ♦ is an 
arithmetic operator and n is a numeric value if required by the arithmetic 
operator). In addition, an executing condition for executing the operation on the 
variable is expressed as an attribute name="executing condition of corresponding 
tag" (step 1303). For example, the executing condition for executing the 
operation on the variable may be var^"'if phrase". 

[81] FIG. 14 is a flowchart for explaining a method of creating multimedia 
content using SMIL with an additional function, according to an embodiment of 
the present invention. 
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[82] Referring to FIG. 14, at least one function is defined (step 1401). For 
example, a function is defined as true when rendering regions of an element and a 
corresponding element overlap with each other or when rendering regions of at 
least one element overlap with one another. Next, content, which must be 
processed when the defined function is true, is expressed using an attribute of a 
predetermined element (step 1402). For example, the content may be expressed 
using an "action" attribute. That is, rendering of the corresponding element can 
be completed or begun using the action attribute. 

[83] As described above, SMIL content according to the present invention has 
a memory function, thus it is possible- to accumulate, store, and display results of 
user input using only SMIL content, without the need for connection to a server. 
That is, it is possible to simply implement a memory function using newly 
defined attributes of SMIL without additional progranmiing. The SMIL content 
is effective particularly in a mobile environment due to the restrictions to 
resources in the mobile environment. Even developers who do not know a 
programming language can create SMIL content which supports user interaction. 

[84] While the present invention has been particularly shown and described 
with reference to exemplary embodiments thereof, it will be understood by those 
of ordinary skill in the art that various changes in form and details may be made 
therein without departing from the spirit and scope of the present invention as 
defined by the following claims. 
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